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Abstract 

This is the first part of a two-part paper that studies the problem of jamming in a fixed-rate transmission system with fading, 
under the general assumption that the jammer has no knowledge about either the codebook used by the legitimate communication 
terminals, or the source's output. Both transmitter and jammer are subject to power constraints which can be enforced over each 
codeword (short-term / peak) or over all codewords (long-term / average), hence generating different scenarios. All our jamming 
problems are formulated as zero-sum games, having the probability of outage as pay-off function and power control functions 
as strategies. The paper aims at providing a comprehensive coverage of these problems, under fast and slow fading, peak and 
average power constraints, pure and mixed strategies, with and without channel state information (CSI) feedback. In this first 
£SJ ' part we study the fast fading scenario. We first assume full CSI to be available to all parties. For peak power constraints, a Nash 

equilibrium of pure strategies is found. For average power constraints, both pure and mixed strategies are investigated. With pure 
strategies, we derive the optimal power control functions for both intra-frame and inter-frame power allocation. Maximin and 
minimax solutions are found and shown to be different, which implies the non-existence of a saddle point. In addition we provide 
alternative perspectives in obtaining the optimal intra-frame power control functions under the long-term power constraints. With 
mixed strategies, the Nash equilibrium is found by solving the generalized form of an older problem dating back to Bell and 
Cover [1]. Finally, for comparison purposes, we derive a Nash equilibrium of the game in which no CSI is fed back from the 
receiver. We show that full channel state information brings only a very slight improvement in the system's performance. 

Keywords: Fast fading channels, fixed rate, A-capacity, jamming, zero-sum game, outage probability, power control. 
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c/3 . I. Introduction. 

I The importance of designing anti-jamming strategies cannot be overstated, due to the extremely wide deployment of wireless 
networks, the very essence of which makes them vulnerable to attacks. Although the bases of jamming and anti-jamming 
' I strategies have been set in the 80's and 90's [2], [3], [4], new interest has been recently generated by the increasing demand 
I ■ for wireless security. Jamming and anti-jamming strategies were developed for the broadcast channel [5], the multiple access 
| channel [6], and even studied from the perspective of an arbitrarily varying channel [7]. Under all scenarios, the jamming 
Tj" ■ problem is formulated as a two-player, zero-sum game. The corresponding objective functions are the sum-rate [5], the ergodic 
C*~) | capacity [6] or the A-capacity [7]. Although most often the jammer is assumed to have access to either the transmitter's output 
QO ■ or input [2], [4], [8] and consequently is able to produce correlated jamming signals, the correlation assumption can only be 
| accurate for repeater protocols, or other situations where the jammer gets the chance to jam a signal about which it has already 
obtained some information from eavesdropping previous transmissions. 

The approach of [7] is quite relevant to our work. The jamming problem is viewed as a special case of an arbitrarily varying 
J> ■ channel (AVC). Constraints are placed either on the power invested in each codeword (peak power constraints), or on the power 
km \ averaged over all codewords (average power constraints). The A-capacity, which is used to evaluate system performance, is 
■ defined as the maximum transmission rate that guarantees a probability of codeword error less than A, under random coding. 
C3 ' It is shown that when peak power constraints are imposed on both transmitter and jammer, the A-capacity is constant for 
< A < 1, and therefore is the same as the channel capacity. No fading is assumed in [7], and consequently no power control 
strategies are necessary. However, fading channels are often the more practical models for wireless applications. 

Traditionally, fast fading channels are characterized by their ergodic capacity, which is completely determined by the 
probability distribution of the channel coefficient and the transmitter power constraints. The physical interpretation of this 
measure of channel quality is related to the capabilities of channel codes. In the fast fading scenario, the codewords are assumed 
long enough to reveal the long-term statistical properties of the fading coefficient (in practical systems, this requirement may be 
satisfied by the use of interleaving [9]). Implicitly, power constraints are imposed over each codeword. Therefore, for achieving 
asymptotic error free communication, all codewords need to be transmitted at the same rate not exceeding the channel's ergodic 
capacity. 

However, applications like video streams in multimedia often require fixed data rates that could exceed the channel's ergodic 
capacity, but can tolerate non-zero codeword error probabilities. Therefore, in situations when the transmitter's available power 
is not sufficient for supporting a certain rate for each codeword in the traditional framework, the transmitter can choose to 
concentrate its power on transmitting only a subset of the codewords, while dropping the others. This maneuver ensures error 
free decoding of the transmitted messages, at the cost of a non-zero probability of message decoding error, which is feasible 
when power constraints are imposed over the ensemble of all codewords, instead of over each single codeword. This justifies 
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the evaluation of fixed rate systems in fast fading channels by a quantity that is best known to characterize slow fading channels: 
the outage probability. Note that unlike the case of slow fading, in fast fading channels, due to the large codeword length, the 
channel conditions affecting the transmission of different codewords are asymptotically identical. 

In this paper, we consider a fast fading AWGN channel where codewords (we denote the span of a codeword by the term 
frame) are considered long enough to reveal the long-term statistical properties of the fading coefficient. Our channel model 
is depicted in Figure Q] It was shown in [10] that the ergodic capacity of the fast fading AWGN channel can be achieved by 
a constant-rate, constant-power Gaussian codebook, provided that when the fading coefficients are available at the transmitter, 
the transmitter employs a dynamic scaling of the code symbols, by the appropriate power allocation function. For this reason 
we assume in out model that the transmitter uses a capacity-achieving complex Gaussian codebook. The jammer is assumed 
to have no knowledge about this codebook or the actual output of the transmitter, and hence its most harmful strategy is to 
transmit white complex Gaussian noise [11]. 

The channel coefficient is a complex number, the squared absolute value of which will be denoted throughout this paper 
by h. The average powers invested by the transmitter and jammer in transmitting and jamming a codeword, respectively, are 
denoted by Pm and Jm- The transmitter and the jammer are subject to either peak power constraints (over each frame, or 
codeword) of the form Pm < V and Jm < J , or average power constraints (over all frames) of the form EPj\/ < V and 
EJm < J, where the expectation is taken with respect to the players' strategies of allocating the powers V and J between 
frames. 

A codeword is decoded with strictly positive probability of error (i.e. outage) if the ergodic capacity calculated over the 
frame is below the fixed rate R. The probability of this event (the equivalent of A in [7]) will be denoted as the probability 
of outage P ou t- The transmitter aims at minimizing the probability of outage for a fixed rate R, while the jammer attempts to 
maximize it. Our contributions can be summarized as below: 

• We first investigate the scenario where full channel state information (CSI) is available to all parties. For this case we 
show that peak power constraints are not efficient for high rate transmissions or large jammer power; 

• We formulate the scenario of average transmitter/jammer power constraints as a two-person, zero-sum game with the 
probability of outage as the pay-off function. 

• Under average power constraints, we first investigate pure strategies and find the maximin and minimax solutions, as a 
result of two levels of power control: one within frames and one concerning the additional randomization introduced by 
the transmitter. Optimal strategies are derived for both levels, and it is shown that a Nash equilibrium of pure strategies 
does not exist in general. 

• As a result, we investigate mixed strategies and find the (unique) Nash equilibrium by solving a generalized version of a 
game that was first discussed by Bell and Cover [1] and then extended by Hughes and Narayan [7]. 

• Finally, for comparison purposes, we find the optimal transmitter and jammer mixed strategies for the case when the 
receiver does not feed back the CSI. Our results show that CSI feedback only brings slight improvements in the overall 
transmission quality. 

One comment is in order. Note that Nash equilibria of mixed strategies are not always the best approach to practical jamming 
situations. An equilibrium of mixed strategies usually assumes that none of the two players knows exactly when or with what 
power the other player is going to transmit. While this may generally be true for the legitimate transmitter, a smart jammer 
might constantly eavesdrop the channel and detect both the legitimate transmitter's presence and its power level. Therefore, 
many real jamming scenarios might be more accurately characterized by the solutions of the maximin problem formulation 
with pure strategies when the jammer tries to minimize and the transmitter tries to maximize the objective, and the solutions of 
the minimax problem formulation with pure strategies when the jammer tries to maximize and the transmitter tries to minimize 
the objective (the latter case applies to the present paper). At worst, these solutions provide a valid lower bound on system 
performance. 
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The paper is organized as follows. Section [TT] formalizes the peak power constrained problem when full CSI is available to 
all parties. It turns out that this problem has an intuitive solution. Under the same full CSI assumption, Section [Til] studies 
the problem of average power constraints and pure strategies, and is divided into three subsections. The first one presents 
the optimal strategies for allocating power over one frame. Using the results therein, the maximin and minimax solutions are 
derived in Subsection IIII-BI Some numerical results are shown in Subsection IIII-CI Section [IV] investigates the problem of full 
CSI, average power constraints and mixed strategies and provides the Nash equilibrium point. The scenario when the channel 
coefficients are only known to the receiver is investigated in Section [V] Finally, conclusions are drawn in Section [VT] 



II. CSI Available to All Parties. Jamming Game with Peak Power Constraints. 



This game represents a more general version of the game discussed in Section IV.B of [6], and its solution relies on the 
results therein. The transmitter's goal is to: 



while the jammer's goal is to: 



where 



Minimize Pr(C(P(h), J(h)) < R) 
Subject to P M = E h [P(h)] < V, 



Maximize Pr(C{P(h), J(h)) < R) 
Subject to J M = E h [J(h)] < J, 



(1) 



(2) 



C(P(h),J(h)) =E„ 



log 1 



hP(h) 



N 



is the ergodic capacity, which is completely determined by the p.d.f. of the channel coefficient p(h) and the transmitter/jammer 
power control strategies P(h) and J(h). The expectation is defined as E;, [/(/i)] = J h f(h)p(h)dh. 

We prove that this game is closely related to the two player, zero-sum game of [6], which has the mutual information 
between Tx and Rx as cost/reward function: 



Tx 



Maximize C(P(h),J(h)) 
Subject to P M < V, 



(3) 



Jx 



Minimize C{P(h), J{h)) 
Subject to Ja/ < J. 

This latter game is characterized by the following proposition, proved in Section IV.B of [6]: 

Proposition 1: The game of (01 and has a Nash equilibrium point given by the following strategies: 



(4) 



P*(h) 



if h< 

if h > 



(5) 



J*(h) 



if h< 
if h > 



ct„ A 



(6) 



where A and v are constants that can be determined from the power constraints and [x] + = max{x,0}. 

The connection between the two games above is made clear in the following theorem, the proof of which follows in the 
footsteps of [12] and is given in Appendix [J 

Theorem 1: Let P*(h) and J*(h) denote the Nash equilibrium solutions of the game described by (f3]) and Then the 
original game of (Q~|i, © has a Nash equilibrium point, which is given by the following pair of strategies: 



P(h) = 



P*(h) if C(P*{h),J*(h))>R 
P a {h) if C(P*{h), J*(h)) <R 



(7) 



J(h) = 



J a (h) if C(P*(h),J*(h))>R 
J*(h) if C(P*(h),J*(h)) <R, 



(8) 
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where P a (h) and J a (h) are some arbitrary power allocations satisfying the respective power constraints. (Note that no particular 
improvements are obtained by setting P a (h) = J a {h) = 0, since only peak power constraints are in effect.) 

The results are intuitive: if the ergodic capacity under the optimal jammer/transmitter strategies is larger than the fixed rate 
R, reliable communication can be established over each frame, and hence the probability of outage is P out = 0. In this case, 
the actual power allocation of the jammer does not matter anymore, since the jammer has already lost the game. 

On the other hand, if the ergodic capacity is less than R, outage occurs on all frames (P ou t = 1), and the actual transmitter 
strategy makes no difference. As will be shown in the next section, enforcing average power constraints in this case gives the 
transmitter more freedom, and results in a smaller outage probability. 



III. CSI Available to All Parties. Jamming Game with Average Power Constraints: Pure Strategies. 

In this section power constraints are imposed over a large number of frames rather than on each frame. The transmitter and 
jammer may increase their transmission and jamming powers over any frame from V to Pm, and from J to Jm, respectively. 
To satisfy the average power constraints imposed by V and J, less power has to be allocated to other frames. We shall 
prove that for both players, the optimal way to control the power allocation between frames is to employ ON/OFF strategies. 
Since all frames are equivalent from the point of view of their corresponding channel realizations, the manner in which the 
"discarded" codewords are picked is somewhat random. However, note that this type of randomization only aims at ensuring 
that a possibly larger Pm or Jm is obtained. We don't consider mixing strategies in this section [13]. Although each player 
picks up a frame randomly, we assume this is known by its opponent when considering the maxmin and minimax problems 
as formulated below. That is, the maximin scenario assumes the transmitter has perfect non-causal access to the jammer's 
strategy (we say the jammer "plays first"), while the minimax case assumes the jammer has perfect, non-causal access to the 
transmitter's strategy (we say the transmitter "plays first"). The first player in the minimax or maxmin cases is always more 
vulnerable in the sense that the follower has the freedom to adapt its strategy such that it minimizes the first player's payoff. 

The minimax scenario is the more practical one. In addition to being pessimistic from the system designer's point of view, 
it accurately models the situation where the jammer (who is not interested in exchanging any information of its own) listens 
to the feedback carrying the channel coefficients and senses the transmitter's presence and power level, hence estimating the 
transmitter's strategy. The maximin scenario is not of less importance, since it is required for determining the non-existence 
of a Nash equilibrium and for comparison with the minimax approach. 

An important remark should be made here. We shall prove in the sequel that under both the pure strategies and the mixed 
strategies scenarios, the optimal power allocation over a frame is done similarly. Therefore, the major difference between the 
two cases is in the strategies of allocating power to different frames. We should note that it is easier for one of the players 
to detect the presence of the other player over a frame, than to estimate the other player's transmission power. Under the 
minimax solution of pure strategies, the jammer only needs to detect the presence of the transmitter (the optimal strategies 
are of ON/OFF type) to have complete information about the transmitter's behavior. However, if the transmitter chose to use 
mixed strategies, a complete characterization of its behavior would require not only knowledge about its presence, but also 
about the power it decided to allocate to that frame. 

The average power constrained jamming game can be formulated as: 

f Minimize Pr(C(P(h), J(h)) < R) 

\ Subject to E[P M ] < V y ' 



f Maximize Pr(C(P(h), J(h)) < R) 
\ Subject to E[J M ] < J 

where Pm and Jm are defined as in ([TJ, (01, the expectation is taken over all frames with respect to the power allocation 
strategies introduced by the transmitter and jammer, and V and J are the upper-bounds on average transmission power of the 
source and jammer, respectively. 



A. Power Allocation within a Frame 

The game between transmitter and jammer has two levels. The first (coarser) level is about power allocation between frames, 
and has the probability of outage as a cost/reward function. The probability of outage is determined by the number of frames 
over which the transmitter is not present or the jammer is successful in inducing outage. This set is established in the first level 
of power control which is investigated in detail in the next two subsections, but which cannot be derived before the second 
level strategies are available. 

The second (finer) level is that of power allocation within a frame. In this subsection we derive the optimal second level of 
power allocation strategies for both maximin and minimax problems, and show they are connected by a special kind of duality. 

Note that decomposing the problem into several (two or three) levels and solving each one separately does not restrict the 
generality of our solution. Our proofs are of a contradictory type. Instead of directly deriving each optimal strategy, we assume 
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an optimal solution has already been reached and show it has to satisfy a set of properties. We first assume these properties are 
not satisfied, and then show that under this assumption there is room for improvement. Thus we prove that any solution not 
satisfying our set of properties cannot be optimal (i.e. the properties are necessary). We pick the properties in such a manner 
that they are sufficient for the complete characterization of the optimal solution. That is, we make sure that the system of 
necessary properties has a unique solution. 

In the maximin case (when jammer plays first), assume that the jammer has already allocated some power Jm to a given 
frame. Depending on the value of Jm, and its own power constraints, the transmitter decides whether it wants to achieve 
reliable communication over that frame. If it decides to transmit, it needs to spend as little power as possible (the transmitter 
will be able to use the saved power for achieving reliable communication over another set of frames, and thus to decrease 
the probability of outage). Therefore, the transmitter's objective is to minimize the power Pm spent for achieving reliable 
communication over each frame. Note that if the jammer is present over a frame, the value of Pm required to achieve reliable 
communication over that frame is a function of Jm- However, the transmitter should attempt to minimize the required Pm 
even when the jammer is absent. The jammer's objective is then to allocate the given power Jm over the frame such that the 
required Pm is maximized. 

In the minimax scenario (when transmitter plays first) the jammer's objective is to minimize the power Jm used for jamming 
the transmission over a given frame. The jammer will only transmit if the transmitter is present with some Pm- The transmitter's 
objective is to distribute Pm within a frame such that the power required for jamming is maximized. 

The two problems can be formulated as follows: 

Problem 1 (for the maximin solution - jammer plays first) 



max 

J(h)>0 



min P M = E h [P(h)], s.t. C(P(h),J(h)) > R 

P(h)>0 

s.t. E h [J(h)\ < J M ; (11) 



Problem 2 (for the minimax solution - transmitter plays first) 



max 

P(h)>0 



min J M = E h [J(h)}, s.t. C(P(h),J(h)) < R 

J(h)>0 



s.t. E fc [P(h)]<Pj 



M- 



(12) 



Let m denote the probability measure introduced by the probability density function (p.d.f.) of h, i.e., for a set stf C M + , 
we have m(s/) = J^p(h)dh. Denote x(h) = J(h) Note that the expectation is defined as Eh[f(h)] = J f(h)p(h)dh. 

Similarly, we define E heS r[f(h)] = j' heX f(h)p(h)dh. 

Solution of Problem 1 

The transmitter's optimization problem: 

hP(h) 



min E h [P(/i)], s. t. E fc 

P(h)>0 



log 1 



'N 



J(h) 



has linear cost function and convex constraints. Write the Lagrangian as: 



Li=Eh[P(/i)]-A E 



log 1 



hP{h) 
~J(h) 



N 



> R 



R 



With the notation c = cxp(i?) , the resulting KKT conditions yield the unique solution [14]: 



where 



P(h) = 



A = c m <-*'' < exp 



A - 



x{h) 



, h 6 



E 



he. 



log 



x(h) 



(13) 



(14) 



(15) 



(16) 



and ./#' C R+ is the set of channel coefficients over which A > x(h)/h, and [z] + = max{z,0}. We say the transmitter is 
"non-absent" over and "absent" on K + \ 

The following proposition, the proof of which is given in Appendix III-A1 states that the jammer should only be present 
where the transmitter is non-absent. 

Proposition 2: The jammer should only transmit where the transmitter is "non-absent". Otherwise, if J(h) > and A < 
x(h)/h for h in some set C K+, the jammer can decrease J(h) over h £ 5? and maintain the same required transmitter 
power over the frame. 
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Substituting ( fT6] l in ( fT3l ), the jammer's problem can be formulated as: 



Find max c^'it 

x(h)>at 



exp 



E 



log 



x(h) 



E 



x(h) 



subject to E fe [x(/i)] < (J M + a 2 N ) 



(17) 



(18) 



Since the set depends on the jammer power allocation J(h), solving the optimization problem above analytically is 
difficult. This is why we next provide an alternative method for finding the solution. Our method examines the properties of 
the sets over which the transmitter is present and Jt" over which the jammer is present, as well as those of the optimal 
transmitter/jammer strategies. 

Fixing the Lagrangian for the jammer's optimization problem can be written as 



L 2 = -P, 



M 



This yields the new KKT conditions: 



1 



x(h) 



exp 



E 



fi{E h [x(h)]-(J M + a%)] 
x(h) 



(19) 



log- 



h 
1 



m(.*') 1 

c m <-*'' 
= for h e Ji 



Ehe^("x(h) = Jm + (T 2 N m(JZ"), 



M > 0, 



(20) 

(21) 
(22) 



where jtf" is the set of channel coefficients on which the jammer transmits non-zero power. 

For fixed J£' and jtf", the jammer's optimal strategy has to satisfy these KKT conditions. The resulting optimal strategy is 



x(h) 



1 + fj,h 



cexp 



E 



log 



x{h) 



II I /I ' 1 



(23) 



The expression above states that for any two channel realizations with coefficients hi, hj belonging to we have 



x(hi 



> 



x{hj) 
h , 



<f> hi < hj ^ x(hi) < x(hj). 



Note that for any two channel realizations hi, hj £ Ji" (i.e. x(hi) = x(hj) = a 2 N ) we also have 



x(hi) x(hj) 



> 



o hi < hi 



(24) 



(25) 



hi ~ hj -j 

The following proposition brings more insight into the optimal jamming strategy. Its proof is deferred to Appendix IH-B I 

Proposition 3: The optimal jamming strategy is such that x(h)/h is a continuous decreasing function of h over all of M + 
and J(" is of the form jtf" = [h* , oo). Moreover, this implies that «/#' is of the form = [h°, oo). 

The optimal transmitter/jammer strategies for allocating power over a frame are described in Figure [2] 
Substituting d23l into ( TTol l. we get a new expression for A: 

x(h) 



which together with (fT~5b yields 



A = —7-^(1 + nh), for h G 



P(h) = px(h), for h e 



(26) 



(27) 



An interesting remark which supports the results of the next subsection is that, for the optimal solution of Problem 1, fj, 
has to be strictly greater than zero, hence eliminating the possibility that the jammer allocates positive power to frames where 
the transmitter, although "non-absent", could allocate zero power. In Appendix III-BI it is shown how this remark follows from 
Proposition [3] 
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Taking expectation over h € in d23l i. and using the constraint d2Tb . we get 

,4, 



Vph x7 h 

h ^he-M" \ +fi h 



for ft G and x(/i) = for h ^ 



To solve for fi, substitute 



into d23b : 



E 



cexp 



■ cxp 



E 



m(^K')—m(^") 



log 



E 



1 + /i/i 
l0g X 



(28) 



(29) 



The second level power allocation solution for the maximin problem is thus completely determined by the triple , /u), 
or equivalently by (h°, h* , /Lt). By Proposition [3] above, x(h*) = a 2 N (by continuity in h*), and A = a^/h . Rearranging these 
two relations, along with d29l in a more convenient form, we obtain the following system of equations, which has to hold for 
any solution to our problem: 



h° = 



h* 



Jm 

° 2 N 



1 + fxh* 

h 



h* 



- 1 p(h)dh, 



R = 



log h 



1 + /j,h* 



h* 



log 



1 



(30) 



(31) 



1 + fih 



p(h)dh — 
p(h)dh. 



(32) 



The equations above lead to the following result: 

Proposition 4: The solution of the maximin second level power allocation problem is unique. 
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Proof: It is easy to see that the right hand side of ( BTT i is a strictly decreasing function of h*, for fixed fi, and a strictly 
decreasing function of fi, for fixed h*, while being equal to a constant. Hence, for given Jm, OTb yields /i as a strictly 
decreasing function of h* . 

Similarly, the right hand side of d32t is a strictly decreasing function of h* , for fixed \x, and a strictly increasing function 
of fx, for fixed h*, while being equal to a constant. Hence, ( f32t yields \i as a strictly increasing function of ft*. 

Since ( f3TT > and d32l i have to be satisfied simultaneously by any solution, the solution has to be unique. ■ 

Another insightful remark that follows from (I30ll-(l32l) is that as Jm increases, both [i and h* should be decreasing. 
The following proposition, characterizing the Pm{Jm) function, is necessary for deriving the optimal power allocation 
between frames in the next section. The proof is deferred to Appendix III-CI 

Proposition 5: Under the optimal maximin second level power control strategies, the "required" transmitter power Pm over 
a frame is a strictly increasing, unbounded and concave function of the power Jm that the jammer invests in that frame. 

Throughout the remainder of this paper, we shall denote by ^m(Jm) the function that characterizes the "required" transmitter 
power over a frame where the jammer invests power Jm, in the maximin case. 

Solution of Problem 2 

To solve the minimax intra-frame power allocation problem by using the same techniques as in Problem 1 turns out to 
be more difficult. Instead we use the above solution of Problem 1 and show that for both problems, the second level power 
allocation follows the same rules. 

Theorem 2: If Jm,i is the value used for the second constraint in Problem 1 above, and Pm,i is the resulting value of the 
cost/reward function, then solving Problem 2 with Pm = Pm,i yields the cost/reward function Jm = Jm.i- Moreover, any 
pair of second level power allocation strategies that makes an optimal solution of Problem 7, should also make an optimal 
solution of Problem 2, and this also holds conversely. 

Proof: The result is a direct consequence of Theorem [8] in Appendix III-DI if we denote x = P(h), y = J(h), f(x) = 
E h [P(h)], g(y) = V h [J(h)} and h(x, y) = C(P(h), J{h)). ■ 
We shall denote by J'm^Pm) the function that characterizes the "required" jamming power over a frame where the transmitter 
invests power Pm, in the minimax case. By Theorem|2] we have that J? m{.& m(J m)) = Jm and 3^m{^m (Pm)) = Pm- 

Further comments on the power control within frames 

Although the second level optimal power allocation strategies for the maximin and minimax problems coincide, this result 
should not be associated to the notion of Nash equilibrium, since the two problems solved above do not form a zero-sum 
game, while for the game of (O and dlOt . first level power control strategies are yet to be investigated. 

Instead, the result should be interpreted as a form of duality. In fact, a much stronger result can be observed as a consequence 
of Theorem [8] Namely, a similar "duality" property links Problem 1 and Problem 2 above to the auxiliary problem of (O and 
(|4]i appearing in the peak power constraints scenario. This explains the resemblance between the solution of the peak power 
constraints auxiliary problem (O and the solution of Problem! (1261) . (1271) . 

Also, this common solution implies that P(h) = fi(J(h) +ajj) over the set of channel realizations where both jammer 
and transmitter are present. Although the transmitter is also active over the set of nonzero measure ./#' \ as in Figure 
12] under practical conditions the measure m(^' \ ^#") of this set is relatively small. This is the reason why the ^m(Jm) 
curve appears to be linear (although it is not) in Figure [3] of the numerical results section. 

B. Power Allocation between Frames 
The Maximin Solution 

In this subsection we present the first level optimal power allocation strategies for the maximin problem. Recall that all 
frames are equivalent in the sense that they are all characterized by the same channel realizations (although not necessarily 
occurring in the same chronological order). 

The maximin scenario assumes that the transmitter is completely aware of the jammer's power control strategy (only pure 
strategies are considered in this section). Given a jammer's strategy that allocates different jamming powers to different frames, 
the optimal way of allocating the transmitter's power is always to ensure that reliable communication is obtained on the frames 
that require the least amount of transmitter power. The jammer's optimal strategy (which is based solely on this knowledge 
about the transmitter's strategy) is presented in the following theorem. 

Theorem 3: Under the maximin scenario it is optimal for the jammer to allocate the same amount of power Jm = J to all 
frames. 

Proof: The proof relies on the concavity of ,^m{Jm)- Consider the optimal maximin inter-frame power allocation 
strategies. Let ', 3£ denote the sets of frames over which the transmitter and the jammer are present, respectively. Note 
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that the jammer can itself compute the optimal transmitter strategy in response to its own, and hence is fully informed of the 
transmitter's response. 

We first look at the set of frames 5? where the transmitter is active. Denote the power invested by the jammer in this set 
by Note that V is the average "required" transmitter power over J^. 

If the two players' strategies are both optimal, then by modifying the allocation of J&> over the frames of 5?, the new 
average "required" transmitter power over 5? can only be less than or equal to V. In other words, if we denote by jm the 
generic power level allocated by the jammer to a frame in 5? , then 

V = max / ^ > M {jM)dj M (33) 
3M J 

subject to 

/ .UidjM = Jy. (34) 

By writing the KKT conditions for the maximization problem in (l33l and (f34t above, it is straightforward to see that, at 
an optimum, d ^^J I M ^ > should be constant all over S' . Taking into account the fact that &m{]m) is concave, we have that a 
uniform jamming power allocation of over 5? achieves this optimum. 

We next look at the set of frames \ where the transmitter cannot afford to be active. This means that the "required" 
transmitter power over \ 5? is greater than or equal to &M(J^y j ), or equivalently, the power invested by the jammer is 
greater than or equal to Jy. But since the jammer already knows the transmitter's strategy, investing more than Jy in any 
of the frames of 3£ \ 5? would be a waste. 

Therefore, under the optimal maximin inter-frame power allocation strategies, the jammer can invest the same amount of 
power into all the frames of (J 5? (which means 5? C 3£). 

But since the transmitter decides to match the required transmitter power on 5? , there can be no frames where the jammer 
is not active, and hence 3t~ is the set of all frames. ■ 

The jamming power allocated to each frame is Jm = J ■ In this case the transmitter faces an indifferent choice space. The 
power required for the transmitter to achieve reliable communication is Pm(Jm)- Hence, the transmitter's optimal strategy 
is to randomly pick as many frames as possible and allocate power Pm(Jm) to each of them. This is equivalent to saying 
the transmitter is present over a frame with probability p t , given by p t = p^rm ■ The resulting probability of outage is now 

Pout = l~Pt- 

Note that if V > Pm(J), the probability of outage can be reduced to zero. This corresponds to the case when the ergodic 
capacity of the channel, computed in the conventional way, with peak power constraints, is larger than the rate R. 

The Minimax Solution 

Theorem [2] showed that for the minimax problem the power allocation within a frame, as well as the relationship between 
the total powers used by transmitter and receiver over a particular frame, are identical to the maximin problem. Hence, by 
rotating the &m(Jm) plane, we get the characteristic J?m{Pm) curve for the minimax problem. 

The minimax scenario assumes that the jammer knows exactly when and with what power level the transmitter transmits. 
Given a transmitter's strategy that allocates different powers to different (equivalent) frames, the optimal way of allocating the 
jammer's power is such that outage is first induced on the frames that require the least amount of jamming power. 

Under these conditions, the transmitter's optimal strategy is presented in the following theorem. 

Theorem 4: Under the minimax scenario it is optimal for the transmitter to transmit over a maximum number of frames, 
with the same power Pm that minimizes the probability of outage. 

Proof: The proof relies on the convexity of ^m{Pm)- Consider the optimal minimax inter-frame power allocation 
strategies, and let 5? ,S£ denote the sets of frames over which the transmitter and the jammer are present, respectively. It is 
clear in this scenario that 3£ C S?. 

We first look at the set of frames 2£ where the jammer is active. Denote the power invested by the jammer in this set by 
JsCi an d the power invested by the transmitter by V Note that J% is the average "required" jamming power over 26 '. 

If the two players' strategies are both optimal, then by modifying the allocation of Vgc over the frames of 3£ , the new 
average "required" jamming power over 5£ can only be less than or equal to J% . In other words, if we denote by pm the 
generic power level allocated by the transmitter to a frame in 3C ', then 



Jsc = max Jm{Pm)<Ivm (35) 

PM J X 

subject to 

VMdpM = Vsc- (36) 

9C 
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From the KKT conditions for the maximization problem in d35l ) and d36t above, we see that, at an optimum, d "^%^ M ^ 
should be constant all over 36 . Taking into account the fact that J?m{j?m) is convex, we have that a uniform transmitter 
power allocation of V sc over 36 achieves this optimum. 

We should emphasize here that the above arguments hold under the assumption that the jammer is active over the whole set 
36, i.e. when ^KiiPhi) > over 36 '. Of course, the overall required jamming power is increased by increasing the transmitter 
power over some frames of 36 , while neglecting the others. But this action modifies the set 36 itself, and thus the initial 
assumptions. 

We next look at the set of frames y \ 36 where the jammer cannot afford to be active. This means that the "required" 
jamming power over 5? \ 36 is greater than or equal to J'm^kP x\ ° r equivalently, the power invested by the transmitter is 
greater than or equal to V $£. But since the transmitter already knows the jammer's strategy, investing more than Vgr in any 
of the frames of 3* \ 36 would be a waste. 

Therefore, under the optimal maximin inter-frame power allocation strategies, the transmitter can invest the same amount 
of power into all the frames of 3*. ■ 

The frames over which the transmitter allocates the optimal Pm can be chosen at random. This is equivalent to the transmitter 
being active over a frame with probability p t given by p t = -p-. Searching for the optimal Pm is equivalent to searching for 
the optimal p t . 

The jammer's strategy is to attack as many of the frames where the transmitter is present as possible. In order to induce 
outage over these frames, the jammer needs to allocate ^m{Pm) to each of them. This is equivalent to the jammer transmitting 
^m{Pm) on a frame on which the transmitter is present, with probability pj given by pj = — ji^p M - ) ■ Note that pj represents 
the conditional probability that the jammer transmits over a frame, given that the transmitter is present over that frame. Outage 
over a frame occurs in two circumstances: either the transmitter (and consequently also the jammer) decides to ignore the 
frame, or the transmitter attempts to transmit the corresponding codeword, but the jammer is present (and since this is the 
minimax scenario, it is also successful). 

The resulting probability of outage is P out = (1 — p t ) + PjPt or, only as a function of Pm- 

Pout = (l-^-)+ J ■ (37) 
Pm J?m (Pm ) 

The transmitter finds the optimal value of Pm as the argument that minimizes P out above. A numerical approach should perform 
exhaustive search with the desired resolution in the interval [P, PM,max], where PM,max can be set such that VPm > PM,max 
we have P otl t(Pjv/) > 1 — e for a fixed e. Since P out — > 1 as Pm — > oo independently of the ^m(Pm) curve, such a finite 
bound Pu.max exists for any e. 

Note that if the ^m(Jm) curve is strictly concave, the jammer can never achieve an outage probability P out = 1. This is 
because the transmitter can invest all its power over a small enough set of frames, such that the jamming power required to jam 
all the frames in this set exceeds the jammer's power budget. If however the probability measure m is chosen such that 3^m(Jm) 
is an affine function of the form Pm = Pm n + l/OJu, and furthermore if J > 6(V — Pm q), then r , ^ D , > T P p f,Q > -S— 
for all values of Pm, and the probability of outage becomes P out = 1. 



C. Some Numerical Results 

An example of the 3?m{Jm) curve is given in Figure [3] for a fixed rate R = 2, noise power a 2 N = 10 and a channel 
coefficient distributed exponentially, with parameter A = 1/6. 

For the same parameters used to generate Figure [3] the probability of outage was computed for a jammer power constraint 
J = 10 and different values of the transmitter power constraint V. The results were plotted in Figure H] For comparison, the 
same figure shows P «t(P) f° r the case when the jammer does not use any power control strategy (non-intelligent jammer). 
Since the jammer's first level of power control for the maximin scenario reduces to uniformly distributing the available power to 
all frames, the only difference between the maximin scenario and the non-intelligent jammer scenario is in the power allocation 
within frames. However, as seen from Figure |4] this difference is almost negligible. 

Figure [5] shows how the outage probability varies with the rate R, for fixed power constraints V = 30 and J = 10. 
The P ou t{R) curves delimitate the achievable capacity vs. outage regions for both peak power constraints and average power 
constraints (minimax and maximin cases). 

Note that even for the minimax solution of the average power constraints problem, there exist values of V (Figure [4), or of 
the rate R (Figure |5]l for which the outage probability is less than that achievable under peak power constraints. 

Also note that the maximin curve coincides with the peak power constraints curve at large transmitter power (in Figure [4]i 
or at small rates (in Figure |5). Recall that the jammer's strategy in the maximin scenario is the same as in the peak power 
constraints scenario (i.e. the jammer allocates the same amount of power J to each frame). Due to the favorable conditions in 
the regions characterized by large V or small R, the transmitter can also spread its power uniformly over all frames (just like 
in the peak power constraints scenario), overcoming the jammer completely (hence the resulting zero probability of outage). 
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P M vs. J M for o^=10, R=2, h distributed exponentially with parameter X-M6 
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Fig. 3. Pm vs. Jm curve when R = 2, a 2 N = 10 and h is distributed exponentially, with parameter A = 1/6. 



P vs. P for R=2, J=10, °^j-10, h distributed exponentially with parameter ^.=1/6 
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Fig. 4. Outage probability vs. transmitter power constraint V when J = 10, R = 2, cr^ = 10 and h is distributed exponentially, with parameter A = 1/6. 

IV. CSI Available to All Parties. Jamming Game with Average Power Constraints: Mixed Strategies. 

In the previous section we studied the maximin and minimax solutions of the jamming game when only pure strategies 
were allowed. Implicitly, we assumed that the power control strategies employed by the first player are perfectly known to the 
second player, even if they include a form of ON/OFF randomization. We made a case that such a situation as the minimax 
case can emerge when the jammer does not transmit unless it senses that the transmitter is on (and it can always serve as a 
pessimistic scenario for the transmitter). 

However,our previous assumption may sometimes be inappropriate from a practical point of view. For example, if the 
transmitter does not stick with the optimal minimax solution, the jammer may have a hard time following the transmitter's 
behavior. The reason for this is that, as we have already mentioned, the jammer would find it much harder to correctly estimate 
the amount of power that the transmitter invests in a given frame, than to just detect the presence of the transmitter. 

In this section we investigate the jamming game with average power constraints when mixed (probabilistic) strategies are 
considered. Similarly to the pure strategies scenario of the previous section, this game is played on two levels, with the first 
(coarser) level dealing with power allocation between frames. Its cost/reward function is the probability of outage. We assume 
that the jammer's and transmitter's randomized strategies consist of picking the power values to be invested over a frame in 
a random manner. In our previous notation, Pm and Jm are now random variables, and each frame is characterized by a 
realization Om, Jm) of the pair (P M , Jm)- 

Given this realization, each player has to distribute its power over the frame in an optimal way. This is the purpose of the 
second (finer) level of power control. The objective of each player at this level is to make the best of the available resources 
(i.e. the powers (pm, Jm))- This means maximizing (or minimizing, respectively) the average rate supported by the frame, in 
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Fig. 5. Outage probability vs. rate for V = 30, J = 10, rrfj = 10 and h is distributed exponentially, with parameter A = 1/6. 

the hope that the resulting average rate will be above (or below, respectively) the system's fixed rate R. 

A. Power allocation within a frame 

We can formulate the second level of power control similarly to the two-player, zero-sum game of (f3]i and (HJi having the 
ergodic capacity calculated over a frame C(P(h), J(h)) as cost function. The difference is that under the current scenario, 
none of the players knows the other player's constraints, because (Pm, Jm) is a random event. Theorem [5] below provides the 
optimal transmitter/jammer strategies for power allocation within a frame. 

Theorem 5: Given a realization (pm,Jm) of (Pm, Jm), let 3?m(.3m) denote the solution of Problem 1 in Section Hill with 
Jm = 3m, and ^mIpm) denote the solution of Problem 2 in Section Hill with Pm = Pm- 

The transmitter's optimal strategy is the solution of the game in (O and ©, where the jammer is constrained to E/j[J(/i)] < 
J?m(jPm) and the transmitter is constrained to E^[P(/i)] < pm- The jammer's optimal strategy is the solution of the game in 
(01 and (|4j, where the transmitter is constrained to E/j[P(/i)] < 3^m{jm) and the jammer is constrained to E^[J(/i)] < jm- 

Note that each of the two players deploys the strategy that results from the most pessimistic scenario that it can handle 
successfully. 

Proof: Denote the solution of the game in (0 and (|4j, where the jammer is constrained to E^[J(/i)] < ^m(j?m) and 
the transmitter is constrained to E/i[P(/i)] < pm by (Pi(h), Ji(h)), and the solution of the game in (0 and (0, where the 
transmitter is constrained to Eh[P(h)] < £Pm{3m) and the jammer is constrained to ~Eh[J(h)} < jm by (P2(h), J2(h)). 

Denote the solution of the game in (0 and (@), where the jammer is constrained to Eh[J(h)} < jm and the transmitter is 
constrained to Eh[P(h)] < pm by (Po(h), Jq(K)).. 

By the duality property of Theorem in Appendix IH-DI we must have C(P\(h), Ji{h)) = R and C(P2(h), J2{h)) = R- 
We will show that (i) even if mixed strategies are considered for the game in (0 and dU, any Nash equilibrium has the 
same value as the Nash equilibrium of pure strategies; (ii) even if the jammer's power ]m is different from J^m^Pm), the 
transmitter's strategy is still optimal; (iii) even if the transmitter's power pm is different from 3^m{jm), the jammer's strategy 
is still optimal. 

(i) : Since the game of (O and dU is a two-person zero-sum game, all Nash equilibria of mixed strategies yield the same 
value of the cost/reward function [13]. Moreover, the two players are indifferent between all equilibria. It was shown in [6] 
that this game has a Nash equilibrium of pure strategies. But any equilibrium of pure strategies is also an equilibrium of mixed 
strategies [13] and hence it is enough to consider the equilibrium of pure strategies found in [6]. 

(ii) ,(iii): Assume the transmitter plays the strategy given by P\(K). 

If 3m = #?m(pm)> it is clear that the optimal solution for both transmitter and jammer is the solution of the game in (0 
and ©, where the jammer is constrained to Eh[J(h)} < jm and the transmitter is constrained to Eh[P(/i)] < pm- In this 
case, it is as if each player knows the other player's power constraint. 

If 3m < ^m(pm), then by Lemma H in Appendix IH-CI we have that Jo(h) < J\(h). Since C(P(h) 1 J(h)) is a strictly 
decreasing function of J(h) (under the order relation defined in Appendix III-Dt . this implies that C(P\(h) : Jo(h)) > R. Note 
that Jo(h) is the jammer's strategy when the jammer knows the transmitter's power constraint pm- Thus we have shown that 
when the transmitter plays Pi(h) and jm < ^m(pm), the jammer cannot induce outage over the frame even if it knew the 
value of pm- 
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The condition jm > ^m^Vai) is equivalent to pm < 3^m{jm) (by Theorem [8]). In this case, since the jammer plays 
the strategy given by J2Q1), a similar argument as above (but this time applied to the transmitter's strategy) shows that the 
transmitter cannot achieve reliable communication over the frame even if it knew the exact value of jm- 

This accomplishes the proof and shows that (Pi(h), J2(h)) is a Bayes equilibrium [13] for the game with incomplete 
information describing the power allocation within a frame. ■ 



B. Power allocation between frames 

Due to the form of the optimal second level power allocation strategies described in the previous subsection, the outage 
probability can be expressed as 

Pout = Pr{J M > Jm{Pm)} = 

= 1 - Pr{P M > &> m (Jm)}, (38) 

where &m(Jm) is the strictly increasing, unbounded and concave function of Proposition [5] The optimal mixed strategies for 
power allocation between frames are presented in the following theorem. 

Theorem 6: The unique Nash equilibrium of mixed strategies of the two-player, zero-sum game with average power 
constraints described in (O and (TToT > is attained by the pair of strategies {Fp{pM),Fj{jhi)) satisfying: 

F P (& M (y)) ~ k p U([0, 2v]){y) + (1 - k p )A (y), (39) 



Fj{/m{x)) ~ fc,U([0, J M (2v)])(x) + (1 - k^Aoix), (40) 

where U([r, £])(■) denotes the CDF of a uniform distribution over the interval [r,t], and Ao(-) denotes the CDF of a Dirac 
distribution (i.e. a step function), and the parameters k p , kj £ [0, 1] and v £ [max{J r , a fM(V)/2'}, 00) are uniquely determined 
from the following steps: 

1) Find the unique value vq which satisfies: 

VJ=[^u(2vo)-V](2v Q -J). (41) 

2) Compute S(v ) - J^ vo & M (y)dy - 2v V. 

3) If S(vo) < 0, then v is the unique solution of 

/ & M (y)dy -2vV = 0, (42) 
Jo 



and 



k p = 1 (43) 



_ J0> M {2v) 

3 ~ 2v[& M (2v)-VY ( ' 



4) If S(v ) = then v = v , k p = kj = 1. 

5) If S(v ) > 0, then v is the unique solution of 



2v 

& M (y)dy- & M (2v)(2v-J) = 0, (45) 







2vV 

kp ~ & M (2v)[2v-J] (46) 

and 

kj = 1. (47) 

Proof: The proof follows directly from Theorem [9] in Appendix Hill by substituting x = Pm, y = Jm> g{y) = ^Aiiy), 

g~ 1 (x) = J*m{x), a = V and b = J . It is also interesting to note that the condition Jq g(y)dy < g~ 1 {x)dx is satisfied 

because 3^u{y) is unbounded (Proposition [5). ■ 
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P vs. P for R-2, J=10, o^=10, h distributed exponentially with parameter 
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Fig. 6. Outage probability vs. transmitter power constraint V when J = 10, R = 2, crj^ = 10 and h is distributed exponentially, with parameter A = 1/6. 

P vs. R for P=30, J=10, °fj-10, h distributed exponentially with parameter ^.=1/6 
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Fig. 7. Outage probability vs. rate for V = 30, J = 10, = 10 and h is distributed exponentially, with parameter A = 1/6. 
C. Numerical results 

For the same parameters as in subsection IIII-CI we evaluated numerically the optimal probabilistic power control strategies. 
Figure [6] shows the probability of outage obtained under the mixed strategies Nash equilibrium, versus the transmitter power 
constraint V, for a fixed rate R = 2, noise power a 2 N = 10, a jammer power constraint J = 10 and a channel coefficient 
distributed exponentially, with parameter A = 1/6. All the previously obtained curves are shown for comparison. 

Figure [7] shows the same probability of outage when V = 30 and the system rate R is varied. 

In both figures it can be seen that the system performance under the Nash equilibrium of mixed strategies is better (from 
the transmitter's point of view) than the minimax and worse than the maximin solutions of the pure strategies game. This is 
expected since the pure strategies solutions assume that the second player (the "follower") is constantly at a disadvantage with 
the first player (the "leader"). 

V. CSI Available to Receiver Only. Jamming Game with Average Power Constraints: Mixed Strategies 

In this section we investigate the scenario when the receiver does not feed back any channel state information. Since we 
have already shown that the long term power constraints problem is the more interesting and challenging one, we further focus 
only on the scenario of average power constraints and mixed strategies. As in the previous sections, we have to discuss two 
levels of power control: within a frame and between frames. 

A. Power allocation within a frame 

The jammer and transmitter powers allocated to each frame will be established in the next subsection. For now we are 
concerned with the optimal power allocation within a frame, given the amounts of power invested in that frame by each 
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one of the players. For a given frame, denote these powers by Pm and Jm, to be consistent with our previous notation. 
Both the transmitter and the jammer will choose a probability distribution for the randomly variable power levels P and J, 
respectively, such that EpP < Pm and E,/J < Jm, where the notations Ep and Ej denote the expectations with respect 
to these probability distributions. For the generic channel use, the channel coefficient h, the transmitter's power P and the 
jammer's power J are all independent random variables, which yield the randomly variable instantaneous mutual information 



k)g( 



1 



hP 

7+^1 



For a frame, this results in the ergodic capacity E/,pj log ( 1 



hP 



where Eft denotes expectation with 



respect to the channel coefficient. 

The transmitter's purpose is to use the allocated power Pm in an attempt to make this ergodic capacity larger than the rate 
R. Similarly, the jammer is concerned with using Jm for making the ergodic capacity fall below R. The problem of allocating 
the power within the frame can be written as: 

E w log( 1+ T hP _ 9 ) . (48) 



Denote L(P, J) = E h log ( 1 



max 

P:E P P<P h 



mm 

J:Ej.7<J A 



hP 



and let us observe that 
h 



dL - E 
dP ~ h ~Ph 



J 



J 



>0, 



N 



(49) 



'N 



dL 
dJ 



= -E fc 



Ph 



(Ph + J + <J N ){J + 



<0, 



(50) 



d 2 L 
dP 2 



-Ei 



Ph + J + a 2 N 



<0, 



(51) 



d 2 L 
dJ 2 



Ph(Ph + 2J 



1*1) 



[J 2 + J(Ph + 2a%) + a%(Ph + o 2 N )Y 



> 0, 



(52) 



which implies that L(P, J) is a strictly increasing, concave function of P for fixed J, and a strictly decreasing, convex function 
of J for fixed P. 
Thus, we can write 



E^p log 1 



< E h log 1 



hP 



Jm + a 



N 



hP, 



Jm 



'N 



< 



< 



< Eft, j log 1 



hP M 



J 



•n 



(53) 



and hence the uniform distribution of Pm and Jm over the frame achieves a Nash equilibrium. A frame to which the transmitter 
allocates power Pm and the jammer allocates power Jm is in outage if and only if 

hP M 



E h log 1 



Jm 



N 



< R. 



(54) 



The probability of this event depends on the power allocation between frames and is the subject of the first level of power 
control treated in the next subsection. 

But before we get to that, we need to make several comments. Note that if we force equality in ( |54b above, we obtain a 
m{Jm) curve as in Section UTTJ It is straightforward to see that the S?' m{Jm) curve is affine, because solving ( f54b with 
equality yields Pm = {J m + &n) where [i! is the (unique) solution of Eft log (1 + n'h) = R. Recall that the curve &m(Jm) 
of Section |nl] (with full CSI) is almost affine due to the fact that the measure of the set of channel realizations, within a frame, 
over which the transmitter is present but the jammer is not, is often quite small. For this reason, we expect the 3?' 'm(Jm) and 
the &m{Jm) curves to be very close to each other. 

Although the two curves are still different in general, they have the same physical interpretation: if the jammer invests 
power jm over a frame, and the power pm invested by the transmitter satisfies pm < m{jm), then the frame is in outage. 
Otherwise, if pm > 2P 1 m(jm), the frame supports the asymptotically error-free decoding of the transmitted codeword. 

As in Section!]]]] we shall denote by J ! ' m {Pm) the "inverse" of the m(Jm) function, or the symmetric of the m(Jm) 
curve with respect to the first bisector. 
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B. Power allocation between frames 

The arguments of this subsection are very similar to those of Subsection IIV-BI and will not be discussed in great detail. We 
have seen that the outage probability can be expressed as 

Pout = Pr{J M > /' m {Pm)} = 

= 1 - Pr{P M > &"m(Jm)}, (55) 

where m{Jm) is an affine, and hence strictly increasing and unbounded function of the form m(Jm) = (i'Jm + I^'^n- 
The optimal mixed strategies for power allocation between frames are presented in the following theorem. 

Theorem 7: The unique Nash equilibrium of mixed strategies of our two-player, zero-sum game with average power 
constraints is attained by the pair of strategies (Fp(pm), Fj{jm)) satisfying: 

F P {x) ~ kpUQji'ojf, 2V + li'o%])(x) + (1 - fcp)A (aO, 



Fj(y) 



2v 



2v + a% 3 



%U([0,2t;])(y) + (l 



2v 



2v + a% : 



where U([r, £])(■) denotes the CDF of a uniform distribution over the interval [r,t], and Ao(-) denotes the CDF of a Dirac 
distribution (i.e. a step function), and the parameters k p , kj G [0, 1] and v <E [ma,x{J', a f' M (V)/2}, oo) are uniquely determined 
from the following steps: 



1) If 



then 



and 



2) If 



then 



'J* 

N 



*3 



fi'J(2V - n'a 



2^ 
J 



NJ 



-J J 




-3 




(56) 

(57) 
(58) 

(59) 
(60) 

(61) 



and 



2vV 



ti'(2v + a a N )[2v-J) 



(62) 



kj = 1. (63) 
Proof: The proof follows directly from Theorem|9]in Appendix Hill by substituting x = Pm, V = Jm< 9{y) = ' m{v), 
g~ 1 (x) = J?' M ix), a = V and b = J . It is also interesting to note that the condition Jq g(y)dy < g~ 1 (x)dx is satisfied 
because 0" m{v) is unbounded. ■ 



17 



P M vs. for 0^=10, R=2, h distributed exponentially with parameter y.=V& 
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Fig. 8. Pm vs. Jm curve with and without CSI feedback when R = 2, a 2 N = 10 and h is distributed exponentially, with parameter A = 1/6. 



P vs. P for R=2, J=10, °^j-10, hi distributed exponentially with parameter ^.=1/6 
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Fig. 9. Outage probability vs. transmitter power constraint V with and without CSI feedback when J = 10, R = 2, = 10 and h is distributed 
exponentially, with parameter A = 1/6. (Mixed strategies.) 

C. Numerical results 

In this subsection we provide the numerical evaluation of our system's performance when no channel state information is 
fed back by the receiver. The parameters are identical to those used in the numerical evaluation of the previous sections. 

The new &m(Jm) curve is given in Figure [8] It can be seen that for a given jamming power allocated to a frame, the 
transmitter power required to ensure asymptotically error-free transmission over that frame is only slightly larger if no CSI is 
fed back than when full CSI is available to all parties. 

This observation explains the very small difference in achievable outage probabilities that can be observed in Figures [9] and 

m 

VI. Conclusions 

We have shown that for a high transmission rate R the jammer could have enough power to keep the ergodic capacity 
below R. In this scenario, if the transmitter imposes average power constraints rather than peak power constraints, reliable 
communication is possible at the cost of a non-zero probability of outage. 

If both transmitter and jammer use average power constraints, their optimal strategies result as solutions of a two-person 
zero-sum game. This game is played on two levels of power control. The second level (power control within a frame) exhibits 
similar strategies for the pure (maximin and minimax cases) and mixed strategies scenarios. However in the pure strategies 
scenario, maximin and minimax first level power control (between frames) is generally done differently, implying the non- 
existence of a Nash equilibrium. A Nash equilibrium was derived for the mixed strategies scenario, placing the value of the 
objective function between those of the minimax and maximin pure strategies solutions. 
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P vs. R for P=30, J=10, °m=10, h distributed exponentially with parameter 
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Fig. 10. Outage probability vs. rate with and without CSI feedback for V = 30, J = 10, a^ N = 10 and h is distributed exponentially, with parameter 
A = 1/6. (Mixed strategies.) 

Although it may seem that the mixed strategies game makes more sense from a practical point of view, the pure strategies 
minimax scenario may be a more appropriate model for the case when the jammer does not attempt to jam unless it senses that 
the transmitter is on. In any circumstances, the minimax scenario with pure strategies serves as a lower bound (the pessimistic 
approach) to the system's performance. 

The feedback of CSI by the legitimate receiver is known to bring benefits (in terms of achievable transmission rate) when 
nobody attempts to jam the transmission. However, for a fast fading AWGN channel, these improvements are shown to be 
marginal [15]. We have shown that a similar conclusion holds (this time in terms of outage probability) for the case when the 
parties that communicate over the fast fading AWGN channel are under attack from a jammer. The CSI fed back can easily 
be intercepted by the jammer, which can then use this information to the transmitter's disadvantage. If one should also take 
into account the loss of bandwidth and the complexity required for CSI feedback and processing, keeping the transmitter (and 
jammer) ignorant of the channel coefficients may seem a better choice. 

The same remark cannot be made for a parallel slow fading AWGN channel. It was shown in [12] that when CSI is fed 
back and no jamming is present, the improvements in terms of probability of outage are significant. In Part II of this paper 
[16] we show that this conclusion also holds if we consider the jamming scenario. In doing this we exploit the similarities 
that the parallel slow fading channel bears to the fast fading channel, and develop new and even more interesting techniques 
to make up for the additional complexity incurred by this new model. 

Appendix I 

Peak Power Constraints - Proof of TheoremQ] 
This proof follows the one described in the Appendix B of [12]. The probability of outage can be written as: 

Pr(C(P(h), J{h)) <R) = E[ X{ c(P ( h),J(h))<R}}, (64) 

where X{.n/} denotes the indicator function of the set srf . Replacing the power allocations by the solutions of the game described 
by (0 and (|4J), we define 

X* = X{c(P'(h),j*(h))<R}- (65) 

We next use the fact that the pair (P* (h) , J* (h)) determines an equilibrium of the game (01, (0). Thus, for any random 
power allocation P(h) satisfying the power constraint, we can write: 

X* < X{C(P(h),j-(h))<R},with probability 1. (66) 

Similarly, for any random J(h), we have 

X* > X{c(P*(h),j(h))<R},with probability 1. (67) 

Now pick some arbitrary power allocation functions P a (h) and J Q (/i), which satisfy the peak power constraints, and set 

P{h) = (l-x*)P*{h)+ X *Pa(h), (68) 



19 



and 

J(h) = (l- X *)Ja(h) + x*J*(h), (69) 
It is easy to see that E/,P(/i) < V with probability 1 , E/j J(h) < J with probability 1, and moreover that 

X* = X{c{P{h),J{h))<RY ( 7 °) 

Note that transmitter and jammer could pick P a (h) = and J a (h) = respectively, but this strategy would not improve 
their performances (power cannot be saved), since the only power constraints are set over frames. 
Now, using (164b , d66l l and d67l i, we get: 

Pr{C{P{h),J{h)) <R)> 
> Pr{C(P{h),J{h)) <R)> 
>Pr(C(P(h),J(h))<R), (71) 
which proves the existence of a Nash equilibrium of the original game. 



Appendix II 

Average Power Constraints: Pure Strategies 

A. Proof of Proposition [2] 

In proving the proposition, we take a contradictory approach. It suffices to show that the situation J(h) > and A < x(h)/h 
cannot be part of the solution of Problem 1. 

Assume that J(h) > and A < x(h)/h for h in some set y C R+. If the jammer decreases the value of J(h) on y, two 
situations are possible. In the first one, J(h) is reduced to zero on y, and the transmitter is still "absent". This happens if 
a 2 N > Xh. In this case, modifying the value of J(h) has no impact upon the value of A, and hence neither upon the outcome. 

In the second case J(h) is reduced to some positive value J'(h), such that the transmitter decides to be "non-absent" over 
y. This happens if J'(h) + a 2 N = X'h. Note that the value of A might be changed to some A'. However, as we shall see 
briefly, if we consider J'(h) that satisfies J'(h) + a 2 N = X'h, then we have A' = A. 

To prove this, let A be given by (TTBT i. and assume that A — x(h)/h > for h G ./#', and A — x(h)/h < for h G 5? . Now 
modify x(h) by decreasing J(h) as above. We have 



A' = c™<-^'u^) I exp 



Note that for h G 5? we have ^j^- — A', so 
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Taking logarithm of d72l i: 
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(74) 



and noting that the left hand side of ( III-Ab is independent of the actual realizations of h, we can compute the expectation over 
hey, and get: 

m (y) 
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Using d73l . this leads to 
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Therefore the outcome is maintained because, although "non-absent", the transmitter still invests zero power on 5? . 

Hence if such a situation where the jammer transmits on a set of channel coefficient values over which the transmitter is 
"absent" occurs, the jammer can save power and maintain the same outcome. Meanwhile the new set over which jammer 
transmits becomes a subset of the new set over which the transmitter is "non-absent". 

B. Proof of Proposition \3\ 

We already know that the optimal x(h) is a continuous function of h £ if ./#' and ./#" are fixed. 
The following lemma shows that under this scenario the optimal x(h) is also unique. 

Lemma 1: For fixed and the KKT conditions (f2Qb— (f22l> admit a unique solution. 

Proof: Consider and to be fixed. The constant fi resulting from d20l>-(l22l> can be computed as in (|29l >. This 
implies that Jm(m) is a strictly decreasing function, hence an injection. 

Thus, for a given Jm there exists a unique corresponding value of fi, and since x(h) is a deterministic function of fi, a 
unique solution x(h). ■ 

Suppose the jammer's optimal power distribution x*(h) is not continuous over the whole R+. 

Note that an optimal power distribution x* (h) obtained for fixed and can only be a globally optimal solution (i.e. 
over all possible choices of and ^#"), if by keeping the same and extending to a set ^#" rl that contains a 
discontinuity point , the new optimal strategy is either the same as x*(h), or violates the constraint x(h) > a 2 N . But an optimal 
strategy has to be continuous over and hence the constraint x(h) > ajq has to be violated on the left-most side of n 

(according to (|28])). 

Also note that if under the optimal strategy the jammer allocates some power J x over a set R+, then the distribution 
of J x over should be done optimally, according to ((28), d29l i. This implies that by extending the set ^#by a set jV disjoint 
from , and re-allocating J x over j$ x [J Jf , the constraint x(h) > a 2 N will be violated on the left-most side of ^ x [J JV . 

The arguments above imply the following: 

1) The optimal jamming power allocation should be such that x(h) = a 2 N on the left-most point of otherwise extend 
«/#" by an arbitrarily small set to the left and increase Jm until x(h) = ajj on the left-most point of the new set «/#" 
by continuity of x(h), the left-most point of jtft" should be arbitrarily close to a 2 N . 

2) The optimal jamming power allocation should be such that JH" = [h* , oo): otherwise take a subset ./$ x C such 
that there exists a set jY situated to the right of ./^ x , and denote by J x the jamming power originally allocated to ^ x . 
By re-allocating J x over [J JY , the constraint x(h) > crj^ will be violated on the left-most side of j£ x . If JY is 
picked of arbitrarily small m-measure, by the previous arguments we should have x(h) arbitrarily close to a 2 N at the 
left-most point of j% x . But since j% x is arbitrary, this yields the contradiction that x(h) = a 2 ^ for any h to the left of 
JY. 

This proves Proposition [3] 

Note that if fx = 0, then P{h) = over ./#", and since x(h)/h is decreasing over the whole M + , and jM" = [h* , oo), this 
implies that the transmitter does not transmit at all. However, this strategy does not achieve an ergodic capacity larger than 
the rate R, and hence it results in a contradiction. 

C. Proof of Proposition \5\ 

Recall Proposition |5] Under the optimal maximin second level power control strategies, the "required" transmitter power 
Pm over a frame is a strictly increasing, unbounded and concave function of the power Jm that the jammer invests in that 
frame. 

The fact that £^m(Jm) is strictly increasing follows from Proposition |4] and Proposition [6] If Jm,i < Jm.2 existed such 
that Pm(Jm,i) = Pm(Jm,2), then when the jammer's power constraint is Jm,2> Problem 1 would either have two different 
solutions, or the solution would satisfy the constraint with strict inequality. 

If Jm — * oo then ( f28b implies that J(h) — > oo for any h. If Pm was finite, this would imply C(P(h), J(h)) — > 0, which 
violates the constraints of Problem 1. Hence ^m{Pm) has to be unbounded. 

In proving concavity of the &m{Jm) function for the case when the channel coefficient h belongs to a continuous alphabet, 
we first show that the solution of the discretized problem (i.e. when h belongs to a discrete alphabet, obtained by some 
discretization of the original continuous alphabet) is unique and converges point-wise to the solution of the continuous problem 
as the discrete alphabet converges to the original continuous alphabet. 

This approach also serves the purpose of legitimizing numerical evaluations. 

Next, we prove that for the discretized problem ^m(Jm) is concave. Finally, we show that point-wise convergence of a 
sequence of concave functions is enough for the concavity of its limit function. 

Consider the uniformly spaced discretization qL + of the interval [0, oo), and a p.m.f. of the channel coefficient h £ gZ + 
that converges to the original p.d.f. as q goes to zero. 
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The maximin second level power allocation problem can still be written as in ( fTTT i, even though the integrals representing the 
expectations can now be written as sums. Moreover, Propositions [2|-[3] and relations (fT5]l-(|29]l hold with the only modification 
that the term "continuous" should be crossed out. 

The second level power allocation solution for the discretized maximin problem is completely determined by the triple 
M" ,\x), or equivalently by (h°,h*,fj,). Instead of (f30b — (f32b we can now write 
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(79) 



(80) 



(81) 



(82) 



where QdW\ denotes the largest element of <jZ + that is less than h and Qu[h] denotes the smallest element of qL + that is 
larger than h. 

Lemma 2: For a given Jm the solution of the discretized maximin second level power allocation problem is unique. 

Proof: It is straightforward to show that for fixed h* the left-most and the right-most terms of inequality (ISTT l (which 
upper-bound and lower-bound Jm/ct^) are strictly decreasing functions of /i, and similarly the left-most and the right-most 
terms of inequality ( f82l are strictly increasing functions of [i. 
Note that 
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l+Hh 
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and 
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i h l±t*L ) p{h) 
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E lo § 
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1 + fxh 
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(85) 



These arguments imply that by keeping fi constant and replacing h* by h* — q in both first terms of ( ISTI i and (1821) . we get 
exactly the last terms of ( T8Tb and (182b . respectively. Thus, if (h*,fi) satisfy both dHTT i and ( f82l >. then decreasing /i* (by more than 
one step) and maintaining the same fi violates both (f8TT > and (1821 1. In order for ( T8TT > to still hold, should be increased, while 
in order for (l82l l to still hold, /i should be decreased. But once h* and [i are given, A and hence h° are uniquely determined. 
Therefore there cannot exist more than one solution to the discretized problem. ■ 

The following lemma deals with the convergence of this solution as q — > 0. 

Lemma 3: For a given Jm, the solution of the discretized maximin second level power allocation problem converges to the 
solution of the continuous problem as q — > 0. 

Proof: This follows by noticing that as q — > d77|i-(|79ll become arbitrarily close to (|30il-(l32"ii, and the sums involved in 
the expectations converge to integrals (by the definition of the Riemann integral). ■ 
Next we prove that for the discretized problem, the resulting ^m(Jm) function is concave. We first show in Lemma [4] 
that the optimal jammer strategy {x* (h)}f£L is a continuous function of the given jamming power Jm- Lemma [5] proves that 
Pm{{x(K)}) is continuous and has continuous first order derivatives. This implies that &m{Jm) is in fact continuous and has 
a continuous first order derivative. Finally, Lemma [6] shows that for any fixed M 1 and M" the function 3^m{Jm) is concave. 

Lemma 4: The optimal jammer power allocation {x*(h)}heqZ + within a frame is a continuous increasing function of the 
given jamming power Jm invested over that frame. 

Proof: It is clear that x(h) is continuous and increasing as a function of Jm if h* and h° are fixed. At any point where 
either h* or h° change as a result of a change in Jm, the optimal jamming strategy {x*(h)}h£qz + maintains continuity as a 
result of the uniqueness of the solution (Lemma 0. ■ 

Lemma 5: Both Pm({x(]i)}) and the derivatives , for h £ qZ + are continuous functions of {x(h)}he q z + - 

Proof: Consider any two points {x\{h)}h^ q z + and {x2{h)}h& q z + and any trajectory T that connects them. 
Without loss of generality, assume that the channel coefficients are always indexed in decreasing order of the quantities ^-j^-- 
For a given vector {x(h)}h£qz + , the required transmitter power is 
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Note that depends upon the choice of {x(h)}. For fixed the continuity and differentiability of Pm{{xQi)}) are 
obvious. Thus, it suffices to show that these properties also hold in a point of T where changes. 

If we can show continuity and differentiability when is increased by including one channel coefficient ho, then larger 
variations of can be treated as multiple changes by one channel coefficient, and continuity still holds. 

Let {xk(h)}h£qi, + be a point of T where the transmitter increases the number of frames over which it transmits as above, 
and denote by Ti the part of the trajectory 1 that is between {xi(h)} and {xk(h)}, and T 2 = X\ 2^.. 



Since P(h ) = (i.e. A = we have \{Jt') = A(^'|J{M)> because they both satisfy 
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Define the "left" and "right" limits Pm ({xk(h)} — ) and Pm({^Cj)}+) as: 
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fto 

where the last equality follows since A = £i^2i . This proves continuity. 

Similar arguments can be used to show the continuity of the derivatives in (18711 . 

Lemma 6: In the discretized case, for fixed h° and h* , the function 3^m{Jm) is concave. 

Proof: 

Write d29b explicitly for the discretized problem: 
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Note that for fixed h° and /i*, Jm is a linear function of g. 

From ( TT3T >. (IT6b and d28T l a similar relation can be found for the required transmitter power Pm 



h'-q 2 
o > 



MP ^ + E P^w 



h=h° 



C 

L h=h 



fly 



p(fc) 



h*—q 



■i 1 ' -| 



Denote 



oo oo . 



24 



and note that for fixed h° and h*, Pm is a linear function of /. 

It suffices to show that f{g) is concave. For this purpose, the derivative — 
g, and hence an increasing function of //. 

Computing the derivatives from d94i l and d96i l we obtain 
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(97) 



Looking at the right hand side of d97l i (the "large fraction"), we notice that the first term in the numerator increases with 
fi. For the second term in the numerator, it is clear that as /j, increases, its numerator decreases faster than its denominator. 
This implies that the whole numerator of the "large fraction" is an increasing function of /i. Similarly, the first term in the 
denominator is clearly a decreasing function of /x. The only thing left is the second term of the denominator. It is straightforward 
to show that its derivative with respect to /x can be written as 



EOC 
h=h* 



P (h) 



h=h* 



h 2 



P (h) 




(i + nhy 



(98) 



If we consider the fact that for any two real numbers a and b we have 

(a 2 + b 2 ) 2 - (a + 6)(a 3 + b 3 ) = -ab{a - bf (99) 

and the summations in d98l ) are positive, it is easy to see that the second term of the denominator of the "large fraction" is 
decreasing with /j,. Hence overall the derivative in dWt increases with fi. ■ 

Lemma 7: The limit of a point-wise convergent sequence of concave functions is concave. 

Proof: Denote the sequence by (f n (x))'^L 1 and its limit by f{x). Point-wise convergence implies that for any x and 
Ve > 0, 3N{x) such that \f(x) - f„(x)\ < e, Vn > N(x). 

Take two arbitrary points x and y, and pick some arbitrary a € [0, 1]. Denote N — max{iV(a;), N(y), N(ax + (1 — a)y)}- 
Then for n > N and any e > we have 

f(ax + (1 - a)y) > f n (ax + (1 - a)y) - e > 
> af n (x) + (1 - a)f n (y) - e > 
> a f{x) + (1 - a)f{y) - 2e, (100) 

where the second inequality follows from the concavity of /„. This implies that / is also concave. ■ 



D. On a special kind of duality 

Take x,y G L 2 [R] and define the order relation x > y if and only if x(t) > y(t) Vi G M. Consider the continuous real 
functions f(x), g(y) and h(x, y) over L 2 [M], such that / is a strictly increasing function of x, g is a strictly increasing function 
of y, and h is a strictly increasing function of x for fixed y and a strictly decreasing function of y for fixed x. 

Define the following minimax and maximin problems: 
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The following result is important in the proof of Theorem [8] below. 
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Proposition 6: For any of the three problems above, the optimal solution satisfies both constraints with equality. 

Proof: Take problem d 1 1 b . Let (xi,yi) be a solution such that f(x\) = F, and assume that h(xi,yi) > H. Since 
h is a continuous, strictly increasing function of x for a fixed y, we can find x n < x\ such that h(x n ,yi) = H. But then 
f(x n ) < f(xi), which means that there exists a better value of x if y = y\, and hence that (x\, y\) is not a solution. 
Therefore, the first constraint has to be satisfied with equality. 

Now assume that .9(2/1) < G. Then we can find yo > yi, such that g(yo) = G. However, since h(x±,yi) = H, we have 
h(xi,yo) < H. In order for the first constraint to be satisfied, we need to replace x\ by some other value xo. We prove next 
that the value xq resulting from this modification will be such that f(xo) > f(xi), which makes the pair (x±, y±) suboptimal, 
thus contradicting the hypothesis that it is a solution, and proving that the second constraint should hold with equality. 

Assume that the value of xo is such that 

f(x ) = F < F. (104) 

Then, replacing yo by yx, we have that (xo,y±) is either a second solution of Problem 1 (if the inequality in ( 1104b holds 
with equality), or a better choice (if the inequality in ( 1104b holds with strict inequality). We can readily dismiss the latter 
case, since (x\, y±) was assumed to be an optimal solution. For the former case, h is a strictly decreasing function of y, thus 
h(xo,yi) > R, which contradicts the first part of this proof. The same arguments work for the problem in ( 1102b . 

Take problem ( 1103b . and denote by (2:3, 2/3) one of its optimal solutions. If (7(2/3) < G, we can increase y up to a value y m 
such that g(y m ) = G. But in turn, this yields h(x3, y m ) < h{x^,y^), making 2/3 suboptimal. Therefore, the first constraint has 
to hold with equality. 

Similarly, if 7(2:3) < F, we can increase x up to a value x m such that f(f m ) = F, yielding h(x m ,y3) > h(x3,ys), and 
thus resulting in a contradiction. Thus the second constraint also holds with equality. ■ 

The main result of this section is the following theorem, which introduces a special kind of duality between the three 
problems in ( TToTb , < fl02l and < fl03l 

Theorem 8: (I) Choose any real values for G and H. Take problem (1101b under these constraints and let the pair (2:1,2/1) 
denote one of its optimal solutions, yielding a value of the objective function f{x\) = F\. If we set the value of the 
corresponding constraints in problems ( 1102b and (1103b to F = Fi, then the values of the objective functions of problems (1102b 
and ( 1103b under their optimal solutions are g(y) = G and h(x,y) = H, respectively. Moreover, (2:1,2/1) is also an optimal 
solution of all problems. 

(II) Choose any real values for F and H. Take problem ( 1102b under these constraints and let the pair (X2, 2/2) denote one of 
its optimal solutions, yielding a value of the objective function 3(2/2) = G%. If we set the value of the corresponding constraints 
in problems (1101b and (1103b to G = G2, then the values of the objective functions of problems (1101b and (1103b under their 
optimal solutions are f(x) — F and h(x,y) = H, respectively. Moreover, (2:2,2/2) is an optimal solution of all problems. 

(III) Choose any real values for F and G. Take problem ( 1103b under these constraints and let the pair (£3,2/3) denote one 
of its optimal solutions, yielding a value of the objective function h(x3,ys) = H3. If we set the value of the corresponding 
constraints in problems ( 1101b and ( 1102b to H = H3, then the values of the objective functions of problems (1101b and (1102b 
under their optimal solutions are f(x) = F and g(y) = G, respectively. Moreover, (213,2/3) is an optimal solution of all 
problems. 

Proof: (I) Take problem (1101b and let (x\,yi) be an optimal solution, such that f(xi) = F. We need to show that 
(:ri,2/i) is also an optimal solution of problems (1102b and ( 1103b . 

Since x\ and 2/1 form a solution of problem (1101b . by Proposition [6] they satisfy the first constraint in problem (1101b with 
equality, and so they also satisfy the first constraint in problem ( 1102b . Furthermore, since the second constraint of problem 
(1102b reads f(x) < F, we note that x\ and y\ are in the feasible set. If we evaluate the cost function at this point, we get 
5(2/1) = G. Thus, keeping x = x\, in problem (1102b . we can only obtain g{y) < G, by minimizing the cost function over y. 

Now take any different value xo ^ x\, satisfying f(xo) = F. If the pair (2:0,2/1) satisfies the first constraint in problem 
(1101b , then it is a solution of problem ( 1101b . and hence the constraints should hold with equality. This implies that (xo,yi) 
also satisfies the first constraint of problem ( 1102b . If (2:0,2/1) does not satisfy the first constraint in problem (1101b . then it 
certainly satisfies the first constraint of problem ( 1102b . Either way, the pair (2:0, 2/1) makes a feasible solution of problem (1102b 
(although possibly not optimal) and, by evaluating the cost function at this point, we get (7(2/1) = G. 

Thus, for any value xq we pick, we should always obtain an optimal solution of problem ( 1102b for which g(y) < G. But 
any such optimal solution has to satisfy the first constraint with equality, hence is also a solution of problem ( 1101b . In turn, 
this implies g(y) = G. But then the original pair (2:1,2/1) is a solution of problem ( 1102b . since it is feasible and yields the 
same cost/reward function. 

Take problem ( 1103b . and denote by (2:3, 2/3) one of its optimal solutions. By Proposition|6]we have 7(2:3) = F and 3(2/3) = G. 
Then either /i(x3,2/3) < H, which implies that (2:3,2/3) is an optimal solution of problem ( 1102b . or /i(x3,2/3) > H and then 
(2:3,2/3) is an optimal solution of problem dlOlb . Either way, the inequality should hold with equality, and hence (2:3,2/3) is 
an optimal solution of both problem (1101b and problem ( 1102b . with ^(2:3, 2/3) = H. But this also implies that (2:1,2/1) is an 
optimal solution of problem ( 1103b . 
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(II) A similar argument can be made if we consider an optimal solution (£2,2/2) of problem ( 1102b . such that 0(2/2) = G. 

(III) Consider an optimal solution (#3,2/3) of problem ( 11031 ), such that /i(#3,2/3) — H, and suppose there exists an optimal 
solution (#2,2/2) °f problem ( 11021 ) is such that 3(2/2) 7^ G. By Proposition |6j (#2,2/2) satisfies /(#2) = F and /i(#2,?/2) = H. 
If 2/(2/2) < G, then (#2,2/2) is an optimal solution of problem d 1 031 > which does not satisfy the constraints with equality, and 
thus Proposition [6] is contradicted. If 2/(2/2) = G2 > G, then if we construct a modified version of problem ( 11031 ), where the 
constraint g(y) < G is replaced by g(y) < G2, we know by the first part of this proof that (#2,2/2) is an optimal solution of 
this new problem, yielding ^(#2,2/2) = H. But the same objective is attained by (#3,2/3), and moreover (#3,2/3) satisfies the 
new problem's constraints since 2/(2/3) = G < G3, and thus is an optimal solution. However, one of the constraints is satisfied 
with strict inequality, thus contradicting Proposition [6] Therefore, (#3,2/3) has to be a solution of problem ( 11021 ). A similar 
argument can be made to prove it is also a solution of problem (110U . ■ 



Appendix III 

Average Power Constraints: Mixed Strategies - A special two-player, zero-sum game with mixed 

STRATEGIES. 

In this section, we present a general form of a special two-player, zero-sum game with mixed strategies. Particular forms 
of this game have been investigated by other authors over the last three decades. The first simplified version was presented by 
Bell and Cover [1], and a slightly more general form was later solved by Hughes and Narayan [7]. 

Problem Statement 

Let g{y) : R + — > R + be a monotone increasing, almost everywhere (a.e.) continuous function such that g(Q) = 0. For 
any point of discontinuity 2/0 such that g{y$) = #1 and 27(2/0 ) = #2 > #1, we define 3(2/0) = #1 (g is left-continuous) and 
<7 _1 (#) = 2/1 for all x E [#i,#2]. For any interval of non-zero measure (2/1,2/2) where g is constant, i.e. g{y) — xo for all 
y E (2/1, 2/2), we define (/ _1 (#o) = 2/1 (<7 _1 is also left-continuous). On the rest of K + , where g is continuous and strictly 
increasing, g^ 1 is defined as the usual inverse function of g. Note that g^ 1 is a monotone increasing, a.e. continuous function. 

Consider the two-player, zero-sum game with mixed strategies defined as follows. The allowable strategies for Player 1 are all 
non-negative, real-valued random variables X satisfying E[X] < a. The allowable strategies for Player 2 are all non-negative, 
real-valued random variables Y satisfying E[F] < b. The payoff function is Pr{X > g(Y)}, which Player 1 seeks to maximize, 
while Player 2 seeks to minimize, by properly picking the probability distributions of X and Y respectively. Throughout the 
sequel, these probability distributions will be represented by their corresponding cumulative distribution functions (CDFs) 
F°(#) andF°(2/). 

Problem Solution 

Theorem 9: (I) If there exists a solution with k x ,k y E [0,1] and v E [max{6/2, g~ 1 (a)/2}, 00) of the following three 
equations: 

b 

2vJ ' '"»V~ g(2v) 



1 - — ) = 1 - K ( 1 - -77T-T ) . (105) 



2va 



J V g(y) d y 



(106) 



fc,= (2 f V)b . (107) 
Jf v) g^(x)dx 

then this solution is unique and the unique Nash equilibrium of the two-player, zero-sum game described above is attained by 
the pair of strategies (i^(#), Fy (y)) satisfying: 

Fx(g(y)) - fexU([0, 2v])(y) + (1 - k x )A (y), (108) 



f°(.g- 1 (#)) ~ k y V([0,g(2v)})(x) + (1 - fc,)A (#), (109) 

where U([r, £])(•) denotes the CDF of a uniform distribution over the interval [r,t], and Ao(-) denotes the CDF of a Dirac 
distribution (i.e. a step function). 

(II) If g is strictly increasing and continuous on [max{6/2, g~ 1 (a)/2}, 00), and g(y)dy < J^. g~ 1 {x)dx, then the system 

in ( 11051 ), ( 11061 ) and ( 11071 ) has a unique solution such that k x ,k y E [0,1] and v E [max{6/2, g~ (a)/2}, 00). Moreover, the 
parameters k p ,kj and v are uniquely determined from the following steps: 

1) Find the unique value vq which satisfies: 



ab = \g(2vo) — o\(2vq — b). 



(110) 
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kj = - , -| ^ - ; - . (113) 



2) Compute 5(u ) = Jo" 9(y)dy - 2v a a. 

3) If S(vq) < 0, then v is the unique solution of 

g{y)dy-2va = 0, (111) 
fc p = 1 (112) 

and 

bg(2v) 
2v[g(2v) - a] 

4) If S(vo) = then v = u , k p = kj = 1. 

5) If S(t>o) > 0, then v is the unique solution of 

r2u 

fl( tf )dy- ff (2«)(2i;-6) = J (114) 
kp = g(2v){2 V - b) (U5) 

and 

kj = l. (116) 

Proo/: 

Before starting the actual proof, several remarks are in order. First, F^(x) can be computed from F^(g(y)) by writing 
x = 9(.9 _1 ( x ))> an d thus by evaluating F^-(g(y)) in y = q^ 1 (x). A similar algorithm works for computing F Y (y) from 
F°(g-\x)). 

Second, note that by following this algorithm, for any point of discontinuity yo of g such that g(y ) = x\ and g{y$) = 
x-2 > x\, we have: 

*x(xi) = FxiQig- 1 ^))) = F°(g(y )) = 

= F°(g(g-\x 2 )))=F°(x 2 ), (117) 

i.e. Player 1 does not allow X to take values in (x\, x 2 ), and 

F Y (y ) = F Y (y+) = F^(g- 1 (g(y+))) = 

= F Y (g~ 1 (x 2 )), (118) 

while by the same rational F Y (yo) = F Y (g~ 1 (xi)), meaning that Player 2 uses a probability mass point in yo. 

Third, for an interval of non-zero measure (yi,y 2 ) where g is constant, i.e. g(y) = xq for all y G (yi,y 2 ), we have: 

F Y (yi) = F Y {g-\g{y x ))) = F Y {g-\x Q )) = 

= F»{g- 1 {g{y 2 )))=F*{y 2 ) 1 (119) 

i.e. Player 2 does not allow Y to take values in (yi,y 2 ), and 

f%(xo) = F%{x+) = F° (g(g- 1 (x+))) = 

= F°(g(y 2 )), (120) 

while by the same rational F^-(xq) = F^-(g(yi)), meaning that Player 1 uses a probability mass point in xq. We now proceed 
with the proof of the first part of the theorem. 

(I) Since this is a two-player, zero-sum game with mixed strategies, it has a unique Nash equilibrium. Let Xq ~ F x and 
Yo ~ F Y denote the random variables with the CDFs in ( 11081 l and (1109b . and X ~ Fx and Y ~ Fy be any arbitrary random 
variables. 
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Note that Pr{X > g(Y)} = / °°[1 - F x {g(y))]dF Y (y) = / °° F Y (g- l (x))dF x (x). We can write 

pQC 

Pr{X > g(Y)} = [1 - F x (g(y))]dF Y (y) = 
Jo 

pOG 

= l-k x U([0,2v])(y)dF Y {y) - 
Jo 

/>oo 

-(l-k x ) A (y)dF Y (y)> 
Jo 



and 



pOC 

Pr{X > g(Y )} = / Fyig-^x^dFxix) = 

JO 

pOO 

= k y V([Q,g(2v)}){x)dF x (x) + 
Jo 

POO 

+ (l-k y ) / A Q (x)dF x (x) < 



<l-ky\l 



9(2 

^-"'('"S))' (122) 

Note that equality holds in the first inequality of (1121b if Fy(2v) = 1, and in the second inequality of ( 1121b if ~E[Y] = b. 
Similarly, equality holds in the first inequality of (1122b if F x (g(2v)) = 1, and in the second inequality of d 1 22b if E[X] = a. 

Since F Y (2v) = F Y (g- 1 (g{2v))) = 1 and F x {g(2v)) = 1 (see ( fT08b . ( fT09l », equalities hold in ( fHTl ) and ( fT22l when 
Fx = F£ and F Y = F Y if and only if 

pOO 

a= xdF x (x) (123) 
Jo 

and 

/>oc 

ydF°(y). (124) 



Although the two CDFs F x (x) and F Y (y) may not be continuous as functions in Jzfi, they admit derivatives in the distribution 
space [17], and thus we can write 

dF x (x) 



poo pc 

/ xdF° x (x) = / 
Jo Jo 



dx 



-dx 



, dF x (g(y)) dg(y) 

g{y) , 7 x j — rfy 

ay 



pOO 7 ,.00 

= (l-My o S (y)g(y)dy + ^ g(y)dy, (125) 
which along with d 123b results in ( 1106b , and similarly 



yoLF°(y) = / g \x) fi x dx 



(1 - k y ) J S {x)g (x)dx + 
k/< 



S(2u) 7o 



g~ 1 {x)dx, (126) 



which together ( 1124b yields ( 1107b . The conditions for (F x (x), F Y (y)^j to achieve a saddle-point is that equality holds between 
the bounds in ( 1121b and ( 1122b . which translates to (1105b . and that there always exists a solution of the system given by ( 1105b . 
(TT06T > and (fTOTt . 
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(II) This part of the theorem provides a general (although not necessary) condition for such a solution to exist and states that 
under this condition no more than one such a solution can exist (although the uniqueness already follows as a consequence of 
the uniqueness of a Nash equilibrium). By substituting d 1 06b and (1 1071 ) in d 1 05b we get 



a(2v - b) 



Io V 9(y)dy 



= 1 - 



b(g(2v) - a) 



(127) 



ff^g-^x)dx 

Denote the left hand side of ( 1127b by L(v) and the right hand side by R(v) for simplicity. Note that for any function g that 
satisfies the conditions set in the problem formulation we have 

g{y)dy = 2vg(2v)- g-\x)dx. (128) 



This relation is best observed graphically in Figure [TT1 
x 

g(2v) 



8(b) 
a 









g(y) 



























> 



2v 



Fig. 11. The relationship between the integrals of g(y) and g 1 (x). 

Computing the derivatives of L(v) and R(v) with respect to v (these derivatives always exist for v > max{6/2, g~ 1 (a) /2}) 
we get 



dL(v) 
dv 



2a 



Io V 9(y)dy 



and 



g(y)dy-g(2v)(2v-b) 
dR(v) 2g'(v)b 



(129) 



dv 

2v(g(2v) - a) 
2g'(v)b 



Jf 2v) g-\x)dx 



!f v) g-^x)dx 
g~ 1 (x)dx 



g(y)dy - 2va 



(130) 



where g'(v) > denotes the first derivative dg(y)/dy, evaluated in y = v, and the second equality in ( 1130b follows from ( 1128b . 

Note that L(v) and R(v) are both probabilities, hence belong to [0, 1]. Therefore, any possible solution of the system in 
(1105b , (1106b and ( 1107b should satisfy 2v > b and g(2v) > a, or equivalently: 

v > max{6/2,.g~ 1 (a)/2}. (131) 

Therefore, in the sequel of this proof we shall implicitly assume that ( 1131b holds true. 



Denote S L (v) = J Q g(y)dy - g(2v)(2v - b) and S R (v) = J Q g(y)dy - 2va. Since 

g(y)dy = 2g(2v), 



d_ 

dv J 



(132) 



we observe that 



dv 



S L (v) =-2g'(v)(2v-b) <0 



(133) 
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and 

^S R (v) = 2(g(2v) - a) > 0, (134) 

which imply that Sl(v) is a strictly decreasing function of v, while Sr(v) is a strictly increasing function of v, for the domain 
of interest v € [max{&/2, <? _1 (a)/2}, oo). 

Note that -^Sr(v) is strictly positive even in the limit as v —> oo, and thus lim^oo Sr(v) = oo. By writing Sl(v) = 

Jo g(y)dy - J/( 6 ) g~ 1 (x)dx, we also have lim^oo S L (v) = -oo. 
A first possible solution: 

An extremum of L(v) is obtained by setting dL }^ = 0, or equivalently 

2v, 

g(y)dy = g(2vi)(2vi-b). (135) 

In our previously introduced notation, this writes Sl(vi) — 0. But since Sl(v) is strictly decreasing on the domain of interest, 
the extremum is unique and is a maximum. 

The values of L(v) and R(v) at this point are given by 

L( Vl ) = R( Vl ) = — ^. (136) 

Moreover, substituting (11351 ) and (11281 ) back in (11061 ) and ( 1107b we get 

l 2via nin\ 

k *,l = , n x/ 7T (137) 

g{2vi)(2vi - b) 

and 

fcy.i = 1- (138) 

Therefore (vi, k x ,i, k y .i) are a solution of the system given by ( 11051 ), ( 11061 ) and ( 11071 ) if and only if k x j g [0, 1]. From (11311 ) 
it is implied that 2vi > b, and hence that k x j > 0. The condition k Xf i < 1 yields 

2via<g(2v l )(2v l -b). (139) 

A second possible solution: 

An extremum of R(v) is obtained by setting = o, or equivalently 

ff (y)dy = 2v r a. (140) 

o 

In our previously introduced notation, this writes Sn(v r ) = 0. When this extremum of R(v) exists, it is also unique and is a 
minimum, since Sr(v) is strictly increasing on the domain of interest. 
The values of L(v) and R(v) at this point are given by 

L(v r ) = R(v r ) = 1 - (141) 
Moreover, substituting (11401 ) back in ( 11061 ) and ( 11071 ) we get 

k x . x = 1 (142) 

and 

ky,r = « / / \ \- (143) 
2v r {g(2v r ) — a) 



Therefore (u r , fc X)T ., A: y!r ) are a solution of the system given by ( 1105b . (11061 ) and ( 11071 ) if and only if k Vir £ [0, 1]. From (11311 ) 
it is implied that g(2v r ) > a, and hence that k y , r > 0. The condition k y , r < 1 yields the same inequality as before: 

2v r a < g(2v r )(2v r - b). (144) 

Recall that L(v) has a unique maximum, while R(v) has a unique minimum. The immediate implication of this is that the 
equation L(v) — R(v) can have a maximum of two solutions. These are the possible solutions discussed above. 
To summarize, have two sets of relations: 

g(y)dy = g(2vi)(2v l - b), 

2via < g(2v l )(2v l - b) (145) 
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and 

g(y)dy = 2v r a, 

2v r a < g{2v r )(2v r - b) (146) 

that could each yield a solution of the system in ( 11051 ). ( 11061 ) and ( 11071 ). 

In the remainder of this proof, we show that at least one of the sets ( 1145b and (1146b has a solution and the sets ( 11451 ) and 
(11461 ) cannot both have different solutions. 

Let i>o denote the value of v in [max{6/2, g~ 1 (a)/2} 1 oo) for which 

2vqo, = g(2vo){2vQ — b), asinFiaur&\2\ (147) 



g(2v ) 
8(b) 



< 






^^^^=8(y) 






i 








j 











_ 

' > 



g~\a) b 2^ f 



Fig. 12. Finding vq. 



Such a value exists and is unique since (11471 ) is equivalent to ab = (g(2vo) — a)(2va — 6), where the term on the right 
hand side is a strictly increasing function of vq on [max{6/2, g~ 1 (a)/2}, oo), with a minimum in vq — max{6/2, g~ 1 (a)/2} 
which is and lim l ,_ >oc (g(2w) — a)(2v — b) = oo. Note that this also implies that 2va < g(2v)(2v — b) can only be satisfied 
if v > Vq. 

Denote S = Sl(v ) = Sr(v ) the common value of Si and Sr in v . If S = 0, then v t = v r = v . If S < or S > 0, 
since Sl(v) is decreasing with v and Sr(v) is increasing with v for the domain of interest, it is not possible to obtain solutions 
larger than vq to both equations Sl{v) = and Sr(v) = 0. 

However, a solution always exists. If S < 0, the solution is guaranteed by the continuity of Sr(v) on the domain of interest, 
and by the fact that lim t ,_ >00 Sr(v) = oo. If S > 0, the solution is guaranteed by the continuity of Sl(v) on the domain of 
interest, and by the fact that lim^^oo Sl(v) < 0, which follows from the condition J Q g{y)dy < g~ 1 (x)dx. Note that 
this condition is only necessary if S > and is illustrated in Figure [T3l 



8(b) 
a 














^ — — * = 8(y) 












> > 



8 (a) 



y 



Fig. 13. The necessary condition for the existence of a solution when S > 0. 

A similar condition can be written for the case when S < 0, that is lim^oo Sr(v) > if and only if g~ 1 (x)dx < 
Ig- 1 (a) 9(y)dy- However, since g is a function and is defined over R + , this latter condition can only be violated if g is constant 
on [a, oo). But this is impossible under the former condition. 

We have thus shown that under the condition that g is strictly increasing and continuous on [max{6/2, g~ 1 (a)/2}, oo), and 
Jo 9(v)dy < Jg^,) g~ 1 {x)dx, the system given by ( 1105b . ( 1106b and ( 1107b always has a solution, and that this solution is unique. 
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Several additional remarks 

Bell and Cover [1] found the solution of our game for the particular case when a = b = 1 and g(y) = y. In the context 
of Gaussian arbitrarily varying channels, Hughes and Narayan [7] extended the previous result to the case where a and b are 
any positive constants, and g(y) = y + c, with c > 0. In the remainder of this section we show that our results can be easily 
particularized to obtain the same results as in [7]. 
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Values of Pr{Z > g(Y)} that are 
achievable by Player 2 (by picking a 
distribution consisting of one or two mass 
points), under certain probability 
distributions of Player 1 . 



The only achievable value of Pr{Z > g(Y)} 
(for any distribution of Player2), under 
the optimal probability distributions of 
Player 1. 
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Fig. 14. Intuitive explanation for the optimality of the strategy in I108I . 



If we force g(0) = <?(0~) = 0, the function g(y) = y + c, Vy > is unbounded, linear, strictly increasing, and has only 
one discontinuity in y = 0. Hence, it satisfies all the conditions set in the problem formulation, as well as those of part (II) of 
our Theorem [9] 

Substituting g(y) = y + c in ( 1145b , we get (Case 1): 



2vf 



2vib - be = 



and 



resulting in 



a < vi + c, 



v i = ~ 
2 



(148) 
(149) 

(150) 



33 



i 






















I 

y 


1 
















■ 












L 


L 


L 


L 


L 




L 


L 


i_ 


L 








) ; 

...J.. \ 














L 


L 


L 


L 






L 


L 


u 


U 








' A 
















- 










— 




--- 

— 





1 


1 

1 

1 


1 

1 

1 


1 

1 


V 











1 

1 

1 

1 


1 

1 

1 

~-i 


l»* 






A 




f 

/ 


/ 

/ 


A 
/ 

i, 

..••/•' 

____ 


■ 

— •**-" 

1 

1 

1 






- 








r 


r 


r 






■ 


r 


r -f 


r 




_ ^ 


/ 






i 




fc. 


r r ■ 









^ Values of Pr{Z > g(Y)} that are 
achievable by Player 1 (by picking a 
distribution consisting of one or two mass 

« points), under certain probability 
distributions of Player 2. 



The only achievable value of Pr{Z > g(Y)} 
X (for any distribution of Player 1), under 
the optimal probability distributions of 
Player 2. 

Fig. 15. Intuitive explanation for the optimality of the strategy in (109) , 
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under the condition that 



a<c+- 



The cost function for this case results from ( 1136b as 

Pr{X > g(Y)} = 



1 + T 



1 



1+T 



(151) 



(152) 



and is also consistent with [7]. Note that although k y = 1 for this case, this does not mean that Player 2 is always on. Recall 
that a discontinuity of g is translated into a mass point for the probability distribution of Y. In this case, the discontinuity in 
y = means that Y = with probability n i^ lti ) = 1 — ^, which is the same as in [7]. 



* - own) vi 

Similarly, substituting g(y) = y + c in ( 1146b . we get (Case 2) 

b 



under the condition that 



Vl= 2 



a > c 







1 + 





(153) 



(154) 



34 



Note that the two conditions (1151b and (1154b are mutually exclusive. The cost function for this case is 

Pr{X>g(Y)} = l-— b —, (155) 

2(a — c) 

and is consistent with [7]. 

In Figure [14] we offer an intuitive explanation of why F^(g(y)) should be uniform over [0,2?;], from a maximin point of 
view. The function g(y) is taken to be linear, with a discontinuity in 0, similar to [7]. Assuming that Player 1 plays first 
(maximin), we note that if F^(g(y)) is not uniform, the second player can pick a strategy that decreases the value of the 
objective Pr{X > g(Y)}. Therefore, in order to provide the second player with an indifferent choice space (the strategy of 
Player 2 can be any probability distribution over [0,2w]), Player 1 should pick F^-(x) such that F^-(g(y)) is uniform over 
[0,2v]. 




Fig. 16. The resulting strategies F^-(x) and Fy(y) for a linear g(y) with a discontinuity in 0. 

Similarly, in Figure [15] we offer an intuitive explanation of why Fy(g _1 (a;)) should be uniform over [0,g(2v)], from a 
minimax point of view. Assuming that Player 2 plays first (minimax), note that if Fy(g _1 (.T)) is not uniform, the first player 
can pick a strategy that increases the value of the objective Pr{X > g(Y) }. 

The optimal distributions resulting from Figures [14] and [15] are shown in Figure Q~6] They are consistent with our theoretical 
results (and the results of [7]) for g(y) = y + c. 
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